Skip to content

Conversation

@JingsongLi
Copy link
Contributor

Purpose

See:

/**
 * A paged output serializer that efficiently handles serialization of rows using memory pages.
 *
 * <p>This serializer uses a two-phase approach:
 *
 * <ol>
 *   <li><strong>Initial phase:</strong> Writes data to an initial buffer until it reaches the
 *       specified page size.
 *   <li><strong>Paged phase:</strong> Once the initial buffer exceeds the page size, switches to
 *       using {@link SimpleCollectingOutputView} with allocated memory segments for efficient
 *       memory management.
 * </ol>
 *
 * <p>The design ensures optimal performance for both small datasets (using single buffer) and large
 * datasets (using paged memory allocation).
 */

Tests

API and Format

Documentation

@JingsongLi JingsongLi closed this Oct 9, 2025
@JingsongLi JingsongLi reopened this Oct 9, 2025
@tsreaper tsreaper merged commit 960dce1 into apache:master Oct 11, 2025
46 of 48 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants